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* ABSTRACT 

Software testing helps ensure not only that the software under development has been 
implemented correctly, but also that further development does not break it. If developers 
introduce new defects into the software, these should be detected as early and inexpensively 
as possible in the development cycle. To help optimize which tests are run at what points in 
the design cycle, we have built Echelon, a test prioritization system, which prioritizes the 
application's given set of tests, based on what changes have been made to the 
program. Echelon builds on the previous work on test prioritization and proposes a practical 
binary code based approach that scales well to large systems. Echelon utilizes a binary 
matching system that can accurately compute the differences at a basic block granularity 
between two versions of the program in binary form. Echelon utilizes a fast, simple and 
intuitive heuristic that works well in practice to compute what tests will cover the affected 
basic blocks in the program. Echelon orders the given tests to maximally cover the affected 
program so that defects are likely to be found quickly and inexpensively. Although the 
primary focus in Echelon is on program changes, other criteria can be added in computing 
the priorities. Echelon is part of a test effectiveness infrastructure that runs under the 
Windows environment. It is currently being integrated into the Microsoft software 
development process. Echelon has been tested on large Microsoft product binaries. The 
results show that Echelon is effective in ordering tests based on changes between two 
program versions. 



* REFERENCES 

Note: OCR errors may be found in this Reference List extracted from the full text article. 
ACM has opted to expose the complete List rather than only correct and linked references. 

1 Thomas Ball, On the limit of control flow analysis for regression test selection, 
Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and 
analysis, p.134-142, March 02-04, 1998, Clearwater Beach, Florida, United States 

2 Thomas Ball , James R. Larus, Branch prediction for free, Proceedings of the ACM 
SIGPLAN 1993 conference on Programming language design and implementation, 

p. 300-313, June 21-25, 1993, Albuguerque, New Mexico, United States 

3 David Binkley, Semantics Guided Regression Test Cost Reduction, IEEE Transactions on 
Software Engineering, v.23 n.8, p. 498-516, August 1997 

4 Tsong Yueh Chen , Man Fai Lau, Dividing strategies for the optimization of a test suite. 
Information Processing Letters, v. 60 n.3, p. 135-141, Nov. 11, 1996 

5 Yih-Farn Chen , David S. Rosenblum , Kiem-Phong Vo, TestTube: a system for selective 
regression testing. Proceedings of the 16th international conference on Software 
engineering, p. 211-220, May 16-21, 1994, Sorrento, Italy 

6 Sebastian Elbaum , Alexey G. Malishevsky , Gregg Rothermel, Test Case Prioritization: A 
Family of Empirical Studies, IEEE Transactions on Software Engineering, v,28 n.2, 

p. 159-182, February 2002 



DOI Bookmark: 



Use this link to bookmark this Article: http://doi.acm.org/10.1145/566172.566187 
What is a DOI? 



2 of 5 



8/13/2006 8:34 PM 



